Method and system for visually authenticating the identity of a caller using a video relay service

ABSTRACT

A method and system are disclosed for enabling a real-time visual verification that a video relay service (VRS) call originates from a specific pre-authorized and pre-determined inmate at a corrections facility. The method comprises providing a VRS call recorder, a VRS rules gateway, and a VRS video client being used by the inmate to connect to another VRS client being used by a sign language interpreter (SLI). The display seen by the SLI has a picture-in-picture image showing the inmate (from a database of images of inmates stored in the rules gateway) who should be using the VRS client as well as a real-time video image of the inmate actually using the VRS client. If the picture-in-picture image does not match the live video image, then the audio call to the designated phone number may not be placed by the SLI.

TECHNICAL FIELD OF THE INVENTION

The present invention relates to telecommunications services for callerswho are deaf, hard-of-hearing, or speech impaired, and in particular tovideo relay service (VRS).

BACKGROUND OF THE INVENTION

Traditional telephony presents a problem for persons who are who aredeaf, hard of hearing, or speech-impaired (D-HOH-SI). Communication bytelephone requires each party to a telephone call to be able to hearand/or speak to the other party on the call to communicate. For hearingor speech impaired persons, audio communication is difficult orimpossible, making telephone communication difficult or impossible.

Early approaches to facilitating telecommunications for D-HOH-SI personsincluded text-based telecommunications relay service (TRS). Text-basedTRS services allow a D-HOH-SI person to communicate with other peopleover an existing telecommunications network using devices capable oftransmitting and receiving text characters over the telecommunicationsnetwork. Such devices include the telecommunications device for the deaf(TDD) and the teletypewriter (TTY). Text-based TRS services werewell-suited to the bandwidth limitations of subscriber lines of thetime. The bandwidth limitations of subscriber lines were also a limitingfactor in the widespread use of video telephony.

The availability of affordable, high-speed packet-switchedcommunications has led to the growth in the use of VRS by D-HOH-SIpersons. Using VRS equipment, D-HOH-SI persons can place video calls tocommunicate between themselves and with hearing individuals using signlanguage (SL). VRS equipment enables D-HOH-SI persons to talk to hearingindividuals via a sign language interpreter (SLI), who uses aconventional telephone at the same time to communicate with the party orparties with whom the D-HOH-SI person wants to communicate. Theinterpretation flow is normally within the same principal language, suchas American Sign Language (ASL) to spoken English or spoken Spanish.

VRS calls present a unique set of issues in a corrections environment(e.g., prison, juvenile detention center, etc.). During VRS calls,typically the inmate (“user”) will sit in front of a first VRS terminalcontaining a display and a camera. The SLI will sit in front of a secondVRS terminal which will display a real-time or “live” video image of theuser. The user may then communicate via SL with the SLI, who may thencommunicate through standard audio telephony with a non-D-HOH-SIindividual(s) having a need and/or desire to communicate with the inmate(family member, attorney, clergyman, friend, etc.). For privilegedcommunications with attorneys or clergymen, recording of the VRS call isnot permitted. For other communications, it may be desirable orlegally-required to record the VRS call.

Problems may occur, such as inmates attempting to circumventrestrictions on who may place calls, or to whom calls may be placed. Itwould be advantageous to provide a method and system for preventingunauthorized use of a VRS system for placing calls from a correctionalinstitution.

SUMMARY OF THE INVENTION

Embodiments of the present invention are directed to a method and systemfor providing a visual indication to an SLI that a VRS call originatesfrom a specific pre-determined inmate at a corrections facility. A smallpicture-in-picture of the inmate is displayed on the VRS display of theSLI to enable a visual verification that the inmate shown in thereal-time (live) video on their display matches the appearance of thepre-stored photo displayed in the picture-in-picture. If thepicture-in-picture image and the live video of the user appear to match,the SLI may assume that the specific pre-determined inmate approved forthe call is indeed sitting at the VRS terminal within the correctionalfacility. If the image and video do not appear to match, the SLI maychallenge the identity of the user before proceeding with the audiophone call to the pre-determined number. In situations where the VRSuser from the correctional facility is “trusted”, i.e., is a guard orwarden, etc., then the system and method will not require a pre-storedimage to be displayed for the SLI, and in some situations instead of anSLI the receiver of the VRS call may not be an SLI but rather some othertype of individual (law enforcement, attorney, clergy, family, etc.).

The foregoing has outlined rather broadly the features and technicaladvantages of the present invention in order that the detaileddescription of the invention that follows may be better understood.Additional features and advantages of the invention will be describedhereinafter. It should be appreciated by those skilled in the art thatthe conception and specific embodiments disclosed may be readilyutilized as a basis for modifying or designing other structures forcarrying out the same purposes of the present invention. It should alsobe realized by those skilled in the art that such equivalentconstructions do not depart from the spirit and scope of the inventionas set forth in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more thorough understanding of the present invention, andadvantages thereof, reference is now made to the following descriptionstaken in conjunction with the accompanying drawings, in which:

FIG. 1 is a schematic diagram showing a VRS system in accordance withembodiments of the present invention;

FIG. 2 shows two screen displays for examples with call recording andwithout call recording.

FIG. 3 shows two screen displays for examples where thepicture-in-picture matches the video, and where the picture-in-picturedoes not match the video.

FIG. 4 shows two screen displays for examples of an untrusted user and atrusted user.

FIG. 5 shows a flowchart for a method of storage of data in a rulesgateway for both untrusted and trusted users.

FIGS. 6A and 6B show a flowchart for a method for enabling a real-timevisual verification of the identity of a user in a VRS call according toembodiments of the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Embodiments of the present invention are directed to a method and systemfor enabling a real-time visual verification that a VRS call originatesfrom a specific pre-determined inmate at a corrections facility. In aVRS, an inmate (using VRS client #1) communicates visually with an SLI(using VRS client #2). A small pre-stored picture-in-picture of thespecific pre-determined inmate is displayed by VRS client #2 to enablethe SLI to verify that the inmate shown in the real-time (live) video ontheir display matches the appearance of the pre-stored photo displayedin the picture-in-picture. If the image and video appear to match, theSLI may assume that the specific pre-determined inmate approved for thecall is indeed sitting at the VRS terminal within the correctionalfacility. If the image and video do not appear to match, the SLI maychallenge the identity of the user before proceeding with the phone callto the pre-determined number. In situations where the VRS user from thecorrectional facility is “trusted”, e.g., is a guard or warden, etc.,then the system and method will not require a pre-stored image to bedisplayed for the SLI, and in some situations instead of an SLI thereceiver of the VRS call (using VRS client #2) may not be an SLI butrather some other type of individual (law enforcement, attorney,clergyman, family, etc.). Depending on the identity of the receiver ofthe call from the inmate, who will be communicating verbally with theSLI, the VRS call may be recorded (e.g., a call to family, spouse,ex-spouse, friends, etc.) or may be legally-prevented from beingrecorded (e.g., an inmate-attorney confidential call, orinmate-clergyman call).

VRS System Enabling Real-Time Visual Verification of a User's Identity

FIG. 1 is a schematic diagram 100 showing a VRS system enabling areal-time visual verification of the identity of a user to an SLI inaccordance with embodiments of the present invention. User 104 islocated in proximity to VRS client 105 so that user 104 can interactwith VRS client 105. User 104 may be a person who is deaf (D),hard-of-hearing (HOH), and/or speech-impaired (SI), or any other personwho communicates via SL. User 104 may be an inmate in a correctionsenvironment (e.g., prison, juvenile detention center, etc.) who is aspecific individual having a pre-determined authorization to place a VRScall to a specific phone number. User 104 interacts with VRS client 105by viewing video on display 106. Display 106 is any device suitable fordisplaying to user 104 a video signal from SLI 114 (at VRS client 115),with sufficient video quality and frame rate so that a person fluent inSL can comprehend the SLI. VRS client 105 includes a video capturedevice suitable for capturing a video signal of user 104 within thefield-of-view of the camera at sufficient quality and frame rate tosupport SL communication with SLI 114. VRS client 105 also includeshardware and/or software to, substantially in real-time, convert thecaptured video signal into a data stream suitable for transmission overpacket-switched network 130, such as an internet protocol (IP) network,over network link 132. VRS client 105 also includes hardware/softwarefor adding a picture-in-picture 117 from a database (such as a RulesGateway 135) to the video stream, for the SLI to observe on display 116.VRS client 106 also includes hardware and/or software to transmit thedata stream over packet-switched network 130 at sufficient network speedso that a remote VRS client, such as VRS client 115, can display thedata stream as video on a display device, such as display 116, insufficient quality and frame rate for SLI 114 to comprehend SL from user104 in the displayed video. VRS client 105 can also include hardwareand/or software to, substantially in real-time, receive a data streamfrom a remote VRS terminal, such as VRS terminal 115, frompacket-switched network 130 over network link 132, convert the datastream into a suitable video signal, and output the video signal todisplay 106. In a corrections environment, VRS client 105 may be locatedat the facility where user 104 is incarcerated to that user 104 cancommunicate with persons who are not located at the facility, such asfamily, an attorney, or clergy. VRS client 105 may apply videowatermarks to the VRS call. The video watermarks can include a visualindication that informs one or more parties to the call that the call isbeing recorded. The video watermarks can include a time and/or dateindication. The video watermarks can include an identificationassociated with one or more of the parties to the call, such as aninmate identification number and/or an identification of the correctionsfacility.

Signaling over packet-switched network 130 is preferably implementedusing session initiation protocol (SIP). Alternatively, signaling overpacket-switched network 130 is implemented using the H.323 standard fromthe International Telecommunication Union TelecommunicationStandardization Sector (ITU-T). Those skilled in the art will recognizethat any signaling means suitable for transmitting and receiving videosubstantially in real-time is within the scope of the present invention.

In a preferred embodiment, display 106 can be a high definition flatpanel display with digital inputs, such as digital visual interface(DVI) or high-definition multimedia interface (HDMI) connectors. VRSclient 105 can include digital outputs, such as digital visual interface(DVI) or high-definition multimedia interface (HDMI) connectors. VRSclient 105 can connect to display 106 via compatible cabling, as isknown in the art. User 104 can operate VRS client 105 by a remote inputdevice, such as an infrared (IR), radio frequency (RF), or Bluetooth®handheld remote. VRS client 105 can include a digital video cameraassembly mounted to the front-facing (i.e., user-facing) panel. Thedigital video camera can include an active pixel sensor, such as acomplementary metal oxide semiconductor (CMOS) sensor or acharge-coupled device (CCD) sensor. VRS client 105 can include a networkinterface for establishing network link 132 with packet-switched network130, such as Ethernet support and a wired an RJ-45 connector and/or IEEE802.11 “Wi-Fi” connectivity. VRS client 105 can include one or moreuniversal serial bus (USB) connectors for connecting USB devices, suchas flash accessory (a high light intensity visual indicator) that can beused to alert a D-HOH user that an incoming call is waiting to beanswered. VRS client 105 can also include an interface for flash storagemedia, such as a Secure Digital (SD) non-volatile memory card. VRSclient 105 can include a clamp that can be used to fasten VRS terminal105 to display 106 in so that the camera faces user 104 as user 104views display 106. The clamp can be opened to be alternatively used as adesktop stand.

A single device having an integrated VRS client 105, 115 and displays106, 116 is within the scope of the present invention. Moreover, VRSclient 105, 115 can be implemented as software executing on ageneral-purpose computer meeting the hardware requirements for videotelephony over IP networks and programmed with software to perform thefunctions of VRS client 105, 115 and displays 106, 116 as disclosedherein is within the scope of the present invention. Suchgeneral-purpose computers include desktop personal computers (PC),laptop computers, tablet computers, smartphones, etc. Portable devicessuch as smartphones and tablets having front-facing cameras and IP dataconnectivity can be particularly useful in helping D-HOH-SI personscommunicate with hearing persons via VRS service due to the mobility ofthe portable devices.

VRS client 115 can be operated by the VRS service provider. SLI 114 islocated in order to be able to interact with VRS client 115. While onlyone SLI 114 and one VRS client 115 is shown, one skilled in the art willunderstand that a VRS service provider may comprise a large enterpriseincluding hundreds of SLIs (or more) and sufficient service sideequipment to provide around the clock VRS service to a large number ofusers.

SLI 114 is preferably a person who can communicate via SL and isproficient at SL translation. Display 116 can be any device suitable fordisplaying to SLI 114 the video signal of a user 104 in sufficientquality and frame rate so that SLI 114 can comprehend the SL from user104. VRS client 115 can include a video capture device suitable forcapturing a video signal of SLI 114 within the field-of-view of thecamera at sufficient quality and frame rate to support SL communicationwith user 104. VRS client 115 can also include hardware and/or softwareto, substantially in real-time, convert the captured video signal into adata stream suitable for transmission over packet-switched network 130,such as an internet protocol (IP) network, over network link 134. VRSclient 105 can also include hardware and/or software to transmit thedata stream over packet-switched network 130 at sufficient network speedso that VRS client 105 can display the data stream as video on displaydevice 106 in sufficient quality for user 104 to comprehend SL in thedisplayed video. VRS client 115 can also include hardware and/orsoftware to, substantially in real-time, receive a data stream from VRSclient 105 from packet-switched network 130 over network link 134,convert the data stream into a suitable video signal, and output thevideo signal to display 116.

Service side equipment can also include traditional public switchedtelephone network equipment (PSTN), shown in FIG. 1 as telephone 118.While a simple telephone 118 is shown, one skilled in the art wouldunderstand that any type of equipment for making and receiving PSTNcalls is within the scope of the present invention, including complexenterprise-level telephone systems, computers adapted for placingtelephone calls, and cellular telephones. Telephone 118 is connected tothe public switched telephone network (PSTN) 140 by network link 144 andis capable of making and receiving traditional circuit switchedtelephone calls to PSTN telephone numbers.

Hearing person 124 can be a person who has the ability to communicateover PSTN 140 using at least one spoken language via telephone 128.Telephone 128 is connected to the public switched telephone network(PSTN) 140 by network link 142 and is capable of making and receivingtraditional circuit switched telephone calls to PSTN telephone numbers.While a simple telephone 128 is shown, one skilled in the art wouldunderstand that any type of equipment for making and receiving PSTNcalls is within the scope of the present invention, including complexenterprise-level telephone systems, computers adapted for placingtelephone calls, and cellular telephones.

Rules gateway 135 is connected to packet-switched network 130 overnetwork link 136. Rules gateway 135 may be located in the correctionsenvironment where user 104 is located. Rules gateway 135 may be includedin service side equipment located at a facility operated by the VRSservice provider. Rules gateway 135 can store pre-acquired photos (forfuture use in picture-in-picture) of users wishing to be authorized foruse of the VRS system at the correctional facility. Rules gateway 135can be implemented as a software-as-a-service (SaaS) web service hostedin cloud networking system and accessible by way of packet-switchednetwork 130. Rules gateway 135 can be used to determine whether a VRScall in a corrections environment is to be recorded. Rules gateway 135can be used to modify VRS call properties for recording. The operationof rules gateway 135 is explained in further detail with respect toFIGS. 5 and 6.

Recorder 137 is a device that is capable of recording a VRS call,including audio, video, and any watermarks applied to the call. Recorder137 can be connected to packet-switched network 130 over network link138. Recorder 137 may be located in the corrections environment whereuser 104 is located. Recorder 137 may be included in service sideequipment located at a facility operated by the VRS service provider.Recorder 137 can be implemented as a software-as-a-service (SaaS) webservice hosted in cloud networking system and accessible by way ofpacket-switched network 130. Recorder 137 can be programmed toautomatically record a VRS call based on call properties associated withthe VRS call. The call properties can be modified by the VRS client 105in response to an instruction from rules gateway 135.

Rules gateway 135, recorder 137, VRS client 105, and VRS client 115 canbe implemented as separate and distinct systems that operate independentof location and communicate with each other by way of the Internet.Alternatively, one or more of rules gateway 135, recorder 137, VRSclient 105, and VRS client 115 can be combined to suit a particularapplication. For example, VRS client 105, rules gateway 135, andrecorder 137 can be integrated into one device for installation at acorrections facility that maintains its own recordings on-site. Morethan one device can also be provided for redundancy. For example, arecorder can be installed at a corrections facility and a recorder canbe installed at the service provider, each recorder separately recordingthe VRS call in case one recorder fails.

User 104 initiates a VRS video call to SLI 114. SLI 114 then usestelephone 118 to call hearing person 124 on behalf of user 104. The callto hearing person 124 may be placed automatically by service sideequipment. SLI 114 and user 104 communicate using SL via VRS client 105and VRS client 115. SLI 114 and hearing person 124 communicate usingspoken language via telephone 118 and telephone 128. In this way, SLI114 acts as an intermediary between user 104 and hearing person 124,interpreting the communication between user 104 and hearing person 124.Prior to performing this intermediary function, SLI 114 initiallyperforms a visual verification that the user at VRS client 105 is indeedthe specific pre-determined individual whose photo is shown in thepicture-in-picture display on VRS client 115.

VRS Displays for Recorded and Non-Recorded Calls

FIG. 2 shows two screen displays for examples with call recording 200and without call recording 250. Displays 116 may correspond to thedisplay screen of VRS client 115, being viewed by SLI 114.Picture-in-pictures 206 and 256 show images 208 and 258, respectively,which were taken earlier and stored in the rules gateway 135, asdescribed in FIGS. 1 and 5. In examples 200 and 250, both images 208 and258 show the same inmate “Frank Morris #AL-106785” as indicated by thewindows 210 and 260 at the bottoms of examples 200 and 250. Real-time(live) video images 204 and 254 of authorized user “Frank Morris#AL-106785” are displayed to the SLI for comparison withpicture-in-pictures 206 and 256, respectively. Example 200 maycorrespond to communication between user 104 and various family members,spouse, ex-spouse, fiancée, friends, etc.—these types of communicationsmay typically be recorded both for possible future legal use, as well asa deterrent to illegal communications outside the correctional facility.Example 250 may correspond to privileged communication between the userand his attorney or clergyman—these types of communication may typicallynot be recorded for confidentiality reasons. Also displayed are textinformation 210 and 260 about the user, as well as an indication ofwhether the call is being recorded (example 200) or not-recorded(example 250).

VRS Displays for Calls with Visual Matching and Non-Matching

FIG. 3 shows two screen displays for examples where thepicture-in-picture matches the video 300, and where thepicture-in-picture does not match the video 350. Picture-in-pictures 306and 356 show images 308 and 358, respectively, which were taken earlierand stored in the rules gateway 135, as described in FIGS. 1 and 5—bothimages 308 and 358 show inmate “Frank Morris #AL-106785” as indicated bythe windows 310 and 360 at the bottoms of examples 300 and 350.Real-time (live) video image 304 shows the specific pre-determinedinmate (“Frank Morris #AL-106785”) who is supposed to be using the VRSsystem to communicate with individual(s) outside the correctionalfacility—thus video image 304 looks close enough to pre-stored image 308that the SLI 114 can verify a match. Conversely, video image 354 looksdifferent enough from pre-stored image 358 that the SLI may questionwhether the valid specific pre-determined user is still seated at VRSclient 105. Flowchart 600 in FIGS. 6A and 6B describes a full decisionprocess for responding to this non-matching situation, prior to placingthe audio phone call to the previously-designated receiver of the callfrom the valid user. Both examples 300 and 350 may correspond toprivileged communication between the user and an attorney orclergyman—thus windows 310 and 360 show “Call NOT Recorded”.

VRS Displays for Calls with Untrusted and Trusted Users

FIG. 4 shows two screen displays for examples for an untrusted user 400and a trusted user 450.

Example 400 shows an untrusted user “Frank Morris #AL-106785” inreal-time (live) video image 404 and also in the pre-stored image 408 inpicture-in-picture 406. Window 410 displays the user name and also thatthe call is being recorded, since in this example the call is not to anattorney or clergyman. SLI 114 may verify visually that video image 404is a close match to image 408, and thus that the correct user is seatedat VRS client 105 and the (previously-authorized) call may proceed(while being recorded).

Example 450 shows a trusted user (in this example, the warden) inreal-time (live) video image 454. Since the user is trusted, the systemand method of the invention do not place a picture-in-picture atlocation 456 on display 116. Window 460 does not necessarily provide anyspecific information about the trusted user, however an indication that“Call NOT Recorded” may be provided in some embodiments.

Two Processes of Embodiments

Embodiments comprise two processes:

-   -   1) [FIG. 5] A first, off-line, process of acquiring images of        all potential users of the VRS system (i.e., inmates in the        D-HOH-SI population and capable of using SL). These images may        then be verified and stored in the rules gateway 135 or other        type of image storage device configured to supply these images        to the VRS clients when needed for the picture-in-picture on VRS        clients such as VRS client 115.    -   2) [FIGS. 6A and 6B] A second, real-time, process of displaying        the stored user images from the first process on VRS client 115        for viewing by an SLI 114 to determine whether the specific        pre-determined user is seated at VRS client 105 as required for        authorized use of the VRS system.        Method for Acquisition and Pre-Storage of Images for Use in the        Picture-in-Picture

Pre-storage of images begins at block 502 in the flowchart 500 of FIG.5, which may represent a potential user appearing at a photographicstation within a correctional facility, possibly with documentation toverify their identity in block 504. If the potential user is “trusted”as determined in block 506, i.e., they are a correctional officer,warden, etc., then no image need be acquired, and block 512 is enteredwhere other data may be entered (e.g., a “trusted” status). If thepotential user is “untrusted” as determined in block 506, i.e., they arean inmate, then block 508 is entered and an image of the inmate is takenand then stored in the rules gateway 135 in block 510. Other imagestorage locations also fall within the scope of the invention. In block512, miscellaneous information, such as the user status (“untrusted” or“trusted”) are also stored in the rules gateway 135. Finally, in block514, the user's name and other identifying information (e.g., inmatenumber) are added to an “Authorized User List for VRS”.

Method for Real-Time Visual Verification of the User's Identity

FIGS. 6A and 6B show a flowchart 600 for a method for enabling areal-time visual verification of the identity of a user in a VRS callaccording to embodiments. The method begins at block 602 in FIG. 6A,which may represent a user applying to use the VRS system to call afamily member, spouse, ex-spouse, friend, attorney, clergyman, etc. Theidentity of the user is determined in block 604, where the user name ischecked against the Authorized User List for VRS (which was previouslydetermined in block 514 of FIG. 5) in block 606. If the user is not onthe list, block 608 is entered wherein a designated authority within thecorrectional institution may authorize an “override” of the user rule,which would normally prevent an unauthorized user from accessing the VRSsystem—in this case, block 612 is entered from block 608. Such anoverride might occur in special cases of a family or legal emergency asmight be determined by the circumstances at the time. If circumstancesdo not warrant an override to the user rule, block 610 would be enteredand the user would be blocked from access to the VRS system.

In cases where the user's identification appears on the Authorized UserList, block 612 would be entered out of block 606 and the user's datawould be downloaded from the rules gateway 135 or other location used tostore user data. Based on the downloaded user data, the status of theuser may now be determined in block 614: is the user untrusted ortrusted? If the user is untrusted, block 616 is entered and a pre-storedimage of the user (from block 508 in FIG. 5) is downloaded from therules gateway 135 or other image storage device. The user data includesa list of phone numbers which the user has already been pre-authorizedto call. These numbers may typically include family members, spouses,ex-spouses, friends, attorneys, clergymen, etc. In general, each ofthese individuals may be required or allowed to give permission, or todeny permission, for the user to call them, thus even if a user isauthorized to use the VRS system, all phone calls placed by the user(actually, calls placed on an audio phone by the SLI in block 638) mayonly be placed to pre-authorized numbers from this list.

Depending on the phone number, and the type of phone number (i.e.,family or attorney), the user information in the database in the rulesgateway 135 will determine whether the call can or should be recorded.Typically, calls to family, spouses, ex-spouses, and friends may berecorded, while calls to attorneys and clergymen may legally not beallowed to be recorded—block 620 makes this decision. If the phonenumber indicates the call should and/or is allowed to be recorded, thenblock 622 is entered where the recording device, such as recorder 137 inFIG. 1, is activated. The portion of flowchart 600 in FIG. 6A ends atblock 624, which connects to block 626 in FIG. 6B.

Once the status of the user has been verified as authorized, in block628 VRS client 105 (the user's client) is activated. Next VRS client 115(the SLI's client) is contacted in block 630 and then activated in block632. Once VRS client 115 is online, the picture-in-picture and thereal-time (live) video images should be displayed as illustrated inFIGS. 2-4. At this point, the SLI can compare the video image to thepicture-in-picture in block 634 and then make a decision if these imagesmatch in block 636. If the SLI believes there is a match, block 638 isentered and the audio call from phone 118 to phone 128 is placed, usingthe previously determined phone number from the database in the rulesgateway 135. If the SLI does not believe there is a match, i.e.,possibly the specific pre-determined user has traded places with another(unauthorized) inmate, then block 640 is entered and the properauthorities are notified of the possible problem.

Subsequent actions on the part of the authorities are possible withinthe scope of embodiments. The real-time (live) video image may berelayed along with the picture-in-picture showing the specifiedpre-determined user to another VRS client for review by the properauthorities. In some cases, it is possible that the SLI erred inconcluding that the video image did not match the picture-in-picture andthe user is proper and should be allowed to place the call. In othercases, it could be possible that a rule violation, such as a last-minuteinmate swap, has occurred and the call should remain blocked andpossible disciplinary actions towards both the specific pre-defined userand the “substitute” inmate should be taken.

The following are additional enumerated embodiments according to thepresent disclosure.

A first embodiment, which is a method for verifying that a call using avideo relay service (VRS) system originates from a first user at acorrections facility, the method comprises providing a user verificationsystem, including a first VRS client at the corrections facility; asecond VRS client for use by an SLI; a VRS rules gateway, connected tothe first and second VRS clients; a first audio phone for use by theSLI; loading an image of the first user from the VRS rules gateway;activating the first VRS client to contact the second VRS client; anddisplaying on the second VRS client a real-time (live) video image fromthe first VRS client and a picture-in-picture of the image of the firstuser.

A second embodiment, which includes the method of the first embodiment,further comprising: determining a phone number to be called by the firstuser; and comparing the video image to the picture-in-picture, whereinif the video image matches the picture-in-picture, initiating a callusing the first audio phone to a second audio phone corresponding to thephone number to be called by the first user.

A third embodiment, which includes the method of the first embodiment,further comprising acquiring images of a multiplicity of users of theuser verification system; and storing the images in the VRS rulesgateway.

A fourth embodiment, which includes the method of the first embodiment,further comprising determining if the first user is authorized to usethe VRS system, wherein if the first user is not authorized to use theVRS system, blocking the first user from using the VRS system.

A fifth embodiment, which includes the method of the second embodiment,further comprising determining if the user is a trusted user, wherein ifthe user is a trusted user skipping the loading an image of the firstuser from the VRS rules gateway; the displaying the picture-in-picture;and the comparing the video image to the picture-in-picture.

A sixth embodiment, which includes the method of the first embodiment,further comprising determining if the call should be recorded, whereinif the call should be recorded, activating a call recorder.

A seventh embodiment, which includes the method of the secondembodiment, wherein if the video image does not match thepicture-in-picture, alerting authorities within the correctionsfacility.

An eighth embodiment, which includes the method of the first embodiment,wherein the multiplicity of users of the user verification systemincludes the first user.

A ninth embodiment, which includes the method of the first embodiment,wherein the multiplicity of users of the user verification system doesnot include the first user.

A tenth embodiment, which includes the method of the first embodiment,further comprising displaying a window on the second VRS client showinguser data.

An eleventh embodiment, which is a system for verifying that a callusing a VRS system originates from a first user at a correctionsfacility, comprising a first VRS client at the corrections facility; asecond VRS client for use by an SLI; a VRS rules gateway, connected tothe first and second VRS clients; and a first audio phone for use by theSLI; wherein the second VRS client is configured to display apicture-in-picture of the first user along with a real-time (live) videoimage of a second user at the first VRS client, wherein the second usermay be the same as the first user.

A twelfth embodiment, which includes the system of the eleventhembodiment, wherein the SLI may compare the video image to thepicture-in-picture.

A thirteenth embodiment, which includes the system of the twelfthembodiment, wherein if the if the video image matches thepicture-in-picture, initiating a call using the first audio phone to asecond audio phone.

A fourteenth embodiment, which includes the system of the thirteenthembodiment, wherein the phone number of the second audio phone iscomprised in a list of user data for the first user.

A fifteenth embodiment, which includes the system of the eleventhembodiment, further comprising an authorized users list.

A sixteenth embodiment, which includes the system of the fifteenthembodiment, wherein if the user identity is not on the authorized userslist, the first user is blocked from using the VRS system.

A seventeenth embodiment, which includes the system of eleventhembodiment, further comprising a call recording device.

An eighteenth embodiment, which includes the system of the seventeenthembodiment, wherein the phone number to be called determines whether thecall should be recorded.

A nineteenth embodiment, which includes the system of eighteenthembodiment, wherein if the call should be recorded, activating therecording device to record the call.

While the foregoing describes a preferred embodiment of the presentinvention, one skilled in the art will appreciate that various changes,substitutions and alterations can be made without departing from thescope of the invention. For example, a single device having anintegrated VRS client 105, 115 and display 106, 116 is within the scopeof the present invention. Moreover, VRS clients 105 and 115 implementedas software executing on general purpose computers meeting the hardwarerequirements for video telephony over IP networks and programmed withsoftware to perform the functions of VRS clients 105, 115, and displays106, 116, as disclosed herein is within the scope of the presentinvention. Such general-purpose computers include desktop personalcomputers (PCs), laptop computers, tablet computers, smartphones, etc.Portable devices such as smartphones and tablets having front-facingcameras and IP data connectivity can be particularly useful in helpingD-HOH-SI persons communicate with hearing persons via VRS service due tothe mobility of the portable devices.

Although the present invention and its advantages have been described indetail, it should be understood that various changes, substitutions andalterations can be made herein without departing from the scope of theinvention as defined by the appended claims. Moreover, the scope of thepresent application is not intended to be limited to the particularembodiments of the process, machine, manufacture, composition of matter,means, methods and steps described in the specification. As one ofordinary skill in the art will readily appreciate from the disclosure ofthe present invention, processes, machines, manufacture, compositions ofmatter, means, methods, or steps, presently existing or later to bedeveloped that perform substantially the same function or achievesubstantially the same result as the corresponding embodiments describedherein may be utilized according to the present invention. Accordingly,the appended claims are intended to include within their scope suchprocesses, machines, manufacture, compositions of matter, means,methods, or steps.

I claim:
 1. A method for verifying the identity of a user of a videorelay service (VRS) system at a corrections facility, the methodcomprising: providing a user verification system, including: a first VRSclient at the corrections facility; a second VRS client for use by asign language interpreter; a VRS rules gateway, connected to the firstVRS client and the second VRS client; loading an image of a first userfrom the VRS rules gateway; initiating a VRS call between the first VRSclient and the second VRS client; and displaying on the second VRSclient a real-time video image from the first VRS client and apicture-in-picture of the image of the first user.
 2. The method ofclaim 1, further comprising: comparing the video image to thepicture-in-picture, wherein if the video image includes an image of auser that matches the picture-in-picture, initiating a call between thesign language interpreter to a second audio phone corresponding to thephone number to be called by the first user.
 3. The method of claim 2,further comprising determining if the user is a trusted user, wherein ifthe user is a trusted user skipping the loading an image of the firstuser from the VRS rules gateway; the displaying the picture-in-picture;and the comparing the video image to the picture-in-picture.
 4. Themethod of claim 2, wherein if the video image does not match thepicture-in-picture, alerting authorities within the correctionsfacility.
 5. The method of claim 1, further comprising acquiring imagesof a multiplicity of users of the user verification system; and storingthe images in the VRS rules gateway.
 6. The method of claim 1, furthercomprising determining if the first user is authorized to use the VRSsystem, wherein if the first user is not authorized to use the VRSsystem, blocking the first user from using the VRS system.
 7. The methodof claim 1, further comprising determining if the call should berecorded, wherein if the call should be recorded, activating a callrecorder.
 8. The method of claim 1, wherein the multiplicity of users ofthe user verification system includes the first user.
 9. The method ofclaim 1, wherein the multiplicity of users of the user verificationsystem does not include the first user.
 10. The method of claim 1,further comprising displaying a window on the second VRS client showinguser data.
 11. A system for verifying that a call using a VRS systemoriginates from a first user at a corrections facility, comprising: afirst VRS client at the corrections facility; a second VRS client foruse by a sign language interpreter; a VRS rules gateway, connected tothe first and second VRS clients; and a first audio phone for use by thesign language interpreter; wherein the second VRS client is configuredto display a picture-in-picture image of the first user along with areal-time video image of a second user at the first VRS client, whereinthe second user may be the same as the first user.
 12. The system ofclaim 11, wherein the sign language interpreter may compare the videoimage to the picture-in-picture.
 13. The system of claim 12, wherein ifthe if the video image matches the picture-in-picture, initiating a callusing the first audio phone to a second audio phone.
 14. The system ofclaim 13, wherein the phone number of the second audio phone iscomprised in a list of user data for the first user.
 15. The system ofclaim 11, further comprising an authorized users list.
 16. The system ofclaim 15, wherein if the user identity is not on the authorized userslist, the first user is blocked from using the VRS system.
 17. A methodfor verifying the identity of an inmate at a corrections facility duringa video relay service (VRS) call, the method comprising: initiating aVRS call between an inmate and a called party; prior to contacting thecalled party, comparing a stored image of the inmate with a live imageof the inmate shown during the VRS call; in response to determining thatthe stored image of the inmate matches the live image of the inmateshown during the VRS call, contacting the called party; and in responseto determining that the stored image of the inmate does not match theimage of the inmate shown during the VRS call, terminating the call. 18.The method of claim 17, wherein comparing the stored image of the inmatewith the live image of the inmate shown during the VRS call furthercomprises: displaying the stored image as a picture-in-picture imageoverlaid on at least a portion of the live image of the inmate displayedduring the VRS call; comparing, by a trusted third party, thepicture-in-picture image with the live image of the inmate to determinewhether the stored image of the inmate matches the live image of theinmate shown during the VRS call.
 19. The method of claim 18, in whichthe trusted third party is a sign language interpreter used during theVRS call.
 20. The method of claim 18, in which the trusted third partyis a guard or a warden.
 21. The method of claim 17, wherein comparingthe stored image of the inmate with the live image of the inmate shownduring the VRS call is performed by automated facial recognitionsoftware.
 22. The method of claim 17, wherein comparing the stored imageof the inmate with the live image of the inmate shown during the VRScall is performed substantially continuously for the duration of the VRScall.